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Titl : IMAGE PROJECTION SYSTEM AND METHOD 

CROSS-REFERENCE TO RELATED APPLICATION 
[0001] This application claims priority from U.S. Provisional Patent 
5 Application Serial No. 60/438,675 filed January 8, 2003. 

FIELD OF THE INVENTION 

[0002] This invention relates to projection systems and methods and 
more particularly to a short throw projection system and method which 
combines optics and image processing for reducing optical path length while 
10 maintaining optimum image quality. 

BACKGROUND OF THE INVENTION 

[0003] In a front projection system, the projector and viewer are on the 
same side of the display surface, with the image from the projector reflecting 
from the display surface to the viewer. FIG. 1A shows a standard prior art 

15 eight-element projection lens 5, which can take an input optical image 2 and 
project an expanded output optical image 3. FIG. 1B shows a projection light 
engine 6 that uses the eight element projection lens 5 to project an image 
directly on a display surface 20. This is an example of an on-axis projection 
system in which the image is created and projected along a straight axis 10a 

20 that is perpendicular to the display surface 20. 

[0004] For a rear projection system this design must be made more 
compact to comply with commercial requirements for rear projection screen 
cabinet dimensions. This "compactness" is quantified in terms of the "throw 
ratio". The throw ratio of a projection system is given by the projection 
25 distance d (see FIG. 1B) divided by the diagonal length D (not shown) of 
display surface 20. The diagonal D is measured from the opposite corners of 
the display surface 20. The throw ratio is given by: 

Throw Ratio = — (1) 
D v ' 

[0005] As shown in FIGS. 1C and 1D, the generic projection lens 5 in a 
front projection configuration produces an image with low distortion, having 
30 typical spot sizes (i.e. de-focused point images in the corners). Specifically, 
with display surface 20 having dimensions of 1480mm x 834mm, and a 
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25.4mm f/2.8 projection lens 5, a projected image is produced with 1mm 
spots at the center and 3mm spots at the corners. A reasonable design goal 
for a front projection system is to have a minimum resolvable focused spot 
size of no more than a pixel-span at the center and less than 2-3 pixel-spans 

5 in the corners. In this particular example, taking into consideration the pixel 
size in the micro-display imaging device and the magnification caused by 
projection onto a distant display surface, a pixel-span at the display surface 
20 is about 1mm. The overall lens distortion is less than 1% over the screen 
size of the display surface 20. It is desirable for the distortion map (i.e. FIG. 

10 1C) to be rectangular and to exactly overlay the available display area in 
order to reduce lost pixels and lost brightness (resulting from turning off pixels 
which do not overlay the display screen and consequently losing their 
contribution to overall brightness). Furthermore, it is also desirable for the 
spot diagram of FIG. 1D to show minimal spot size increase (in pixels farther 

15 from the center of the display) and to be symmetrical. Minimizing spot size 
increase implies minimizing point image de-focusing. 

[0006] Another important design goal in building a compact projection 
system is to achieve good image quality while minimizing the throw ratio 
(some designers use the width of the image instead of the diagonal when 

20 computing throw ratio, so it is important to specify which definition of throw 
ratio is being used). Minimizing the throw ratio is especially important for rear 
projection systems in which the projector and screen are physically combined 
into a single functional unit, such as rear projection televisions. In such units 
minimizing the throw ratio implies a shorter projection path length, allowing for 

25 a smaller depth for the cabinet, which houses the display surface and the 
projection light engine. Minimizing the throw ratio in front projection systems 
allows large images to be projected with a projector placed very close to the 
screen. 

[0007] Cabinet depths and depth reductions in rear-projection display 
30 systems are evaluated objectively by measuring the ratio of display diagonal 
to cabinet depth or DtoD ratio. Conventional configurations using on-axis 
projection, flat mirrors, and optical-only means of distortion correction have 
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yielded DtoD ratios of about 2.5 to 3.5 (for example, a 61" diagonal with a 
19.5" depth, or a 55" diagonal with a 18" depth, etc). 

[0008] To decrease cabinet depth, prior art methods have combined 
flat mirrors (to fold the optical path) with low distortion and wide field of view 

5 (FOV) lenses which serve to decrease the projection path length, hence 
decreasing the throw ratio. By fine-tuning the optical geometry (lens type, 
focal distances, mirror angles), image distortions can be minimized. Prior art 
configurations place the fold mirror (or mirrors) on-axis to the projected beam. 
This has the advantage of not producing keystone distortion. However, the 

10 disadvantage is not providing significant cabinet depth reductions, or not 
increasing in the DtoD ratio. 

[0009] For instance, FIG. 2A, shows a prior art projection system 6' 
with a projection light engine 14, a planar mirror 8, and display surface 20. 
This is an example of an on-axis projection system in which the planar mirror 
15 creates a folded optical path and lies at an angle a to the display surface 20. 
The result is a cabinet depth of T. This projection system 6' does not result in 
keystone distortion as can be seen in FIG. 2B which shows an image I 
projected on the display surface 20. 

[0010] The main method for reducing cabinet depth in prior art 
20 configurations is to use short-throw, wide-angle lenses with an on-axis optical 
path. This has the disadvantage of limiting depth reductions, and even though 
keystone distortion is not present, this approach still requires optical elements 
that are challenging to design and manufacture. The optical and geometric 
constraints manifest themselves as increased pincushion or barrel distortion 
25 and keystone distortion. The design of prior art systems has largely been 
constrained by the requirement of minimizing these distortions along with 
achieving a required Modulation Transfer Function (MTF), correcting for 
lateral color, meeting lens F-number specifications, while satisfying cost- 
performance tradeoffs. 

30 [0011] Prior art rear projection systems use screen assemblies that 
have low reflectance to light impinging on them from the front (by use of light 
absorbing materials) in order to provide a high contrast ratio. These screen 
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assemblies also have a high transmittance for light impinging on them from 
the rear (by use of lenticular arrays and collimation of light) in order to provide 
high brightness. Light is typically collimated by using a Fresnel lens as part of 
the screen assembly. A Fresnel lens is a symmetrical circular structure (its 
5 optical center is located at the physical center, or on the axis of the projection 
light path) for on-axis projection systems. A Fresnel lens of a given focal 
length substitutes for a large circular biconvex lens of the same focal length. 
The diameter of such a Fresnel lens is at most the length of the display 
diagonal. These Fresnel lenses are typically thin, very flexible and expand 

10 with interior temperature rise. The image quality for on-axis projection 
systems is not very sensitive to variations in the central portion (around the 
optical axis) of a Fresnel lens' surface profile. Unfortunately, these 
symmetrical Fresnel lenses cannot be used in off-axis RP systems. In 
addition, the Fresnel lens must be carefully designed in projection systems 

15 with high DtoD ratios because the light impinges on the rear of the screen at 
incident angles that vary from a minimum near the bottom of the screen of 
from 20 ±5 degrees to a maximum of up to 60 ±5 degrees near the top of the 
screen. Accordingly, the lens surface must be maintained very precisely 
because of the sensitivity of the collimation function to the angle of incidence 

20 of the impinging light. 

SUMMARY OF THE INVENTION 

[0012] The present invention is a compact rear projection system using 
a rear projection transmissive screen with an integral Fresnel collimation lens. 
Another embodiment of the invention can be a compact front projection 
25 system that is placed very close to a reflective screen. In particular, the 
present invention relates to an off-axis image projection system and method 
for optically projecting an image onto a display surface with visually correct 
geometry and optimum image quality while advantageously reducing the 
optical path length and throw ratio. 

30 [0013] The projection system includes an image processing unit, a 
projection light engine and an optical reflection assembly. The image 
processing unit receives digital input image data, which can differ in resolution 
and aspect ratio, and scales the input image data to the correct aspect ratio 
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and resolution of the projection light engine. The image processing unit also 
applies a distortion compensation to the digital image sent to the light 
modulator using an inverse transform to be described later such that when the 
image-modulated light rays traverse the complete optical path, the rays 
5 undergo the optical and geometric distortion in this path, and emerge towards 
the viewer with no perceptible distortion or fuzziness. In other words, the 
distortion compensation causes every individual pixel at the image modulator 
to be moved in the opposite direction just far enough so that the distortion in 
the light path between the light modulator and the screen moves each pixel 

10 back to its desired position on the screen. The projection light engine receives 
the distortion-compensated image data from the image processing unit in a 
digital format which is translated to signals that cause the light modulating 
micro-display device (or devices) to generate light. This light forms an optical 
image that corresponds to the distortion-compensated image data. The 

15 projection light engine can include a corrector lens that compensates for spot 
defocusing due to the beam spreading that results from the projection 
geometry and the optical reflection assembly. Alternatively, a custom 
projection lens that provides this functionality can be used. 

[0014] The optical reflection assembly is positioned in the optical path 
20 of the distortion-compensated optical image to reflect this image to a specific 
area on the display surface. The optical reflection assembly comprises at 
least one aspherical mirror for controlling reflection to the display surface. The 
aspherical mirror has smoothly varying radii of curvature in both horizontal 
and vertical orientation to help form a substantially visually correct image on 
25 the display surface. The projection light engine and the optical reflection 
assembly are designed to minimize optical anomalies and can compromise 
on spatial accuracy. The image processing unit can perform final correction 
for the combined spatial distortion produced by the projection light engine, the 
optical reflection assembly, changes in projection geometry, as well as errors 
30 in 3 axes of rotational freedom and 2 dimensions of translational freedom 
(up/down, and left/right) in assembly alignment. Fore and aft translational 
errors result in focus changes and cannot be corrected by the image 
processing unit. The display surface is designed to receive light at high and 
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varied angles of incidence and to either reflect or transmit light perpendicular 
to the display screen. 

[0015] Accordingly, in a first aspect, the invention provides an off-axis 
projection system for displaying an optical image on a display surface based 
5 on input image data. The projection system comprises: 

(a) an image processing unit for receiving the input image data 
and generating distortion-compensated image data; 

(b) a projection light engine coupled to the image processing 
unit for receiving the distortion-compensated image data and 

10 projecting a distortion-compensated optical image that 

corresponds to the distortion-compensated image data; and, 

(c) an optical reflection assembly coupled to the projection light 
engine, the optical reflection assembly comprising at least one 
curved mirror, the curved mirror being positioned in the optical 

15 path of the distortion-compensated optical image emerging from 

a projection lens for producing a displayed optical image with 
reduced distortion on the display surface; 
wherein the image processing unit performs distortion compensation on the 
digital values of the input image data such that when the distortion- 

20 compensated optical image is projected through the projection light engine 
and reflected from the optical reflection assembly, the optical and geometric 
distortions associated with the projection light engine and the optical reflection 
assembly are substantially eliminated in the displayed optical image. 
[0016] The invention provides in another aspect, an off-axis projection 

25 method for displaying an optical image on a display surface of an off-axis 
projection system based on input image data. The method comprises the 
steps of: 

(a) receiving input image data in digital format and electronically 
generating distortion-compensated image data; 
30 (b) providing a distortion-compensated optical image that 

corresponds to the distortion-compensated digital image data; 
and, 



-7- 



(c) reflecting the distortion-compensated optical image off an 
optical reflection assembly to produce an display optical image 
for projection on the display surface, the assembly comprising at 
least one curved mirror, the curved mirror being positioned in 
5 the optical path of the distortion-compensated optical image 

emerging from the projection lens to produce a displayed optical 
image on the display surface; 

wherein step (a) comprises applying distortion compensation to the input 

image data such that when the distortion-compensated optical image is 
10 reflected off the optical reflection assembly, the optical and geometric 

distortions associated with the projection system are substantially eliminated 

in the displayed optical image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0017] For a better understanding of the present invention and to show 
15 more clearly how it may be carried into effect, reference will now be made, by 
way of example only, to the accompanying drawings which show an 
exemplary embodiment of the present invention and in which: 

[0018] FIG. 1A is a schematic diagram of a generic eight-element 
projection lens; 

20 [0019] FIG. 1B is a schematic diagram of the projection lens of FIG. 1A 
being used to project an image on-axis on a screen; 

[0020] FIGS. 1C and FIG. 1D are distortion and focus plot diagrams 
that illustrate the distortion inherent in the direct projection system of FIG. 1B; 

[0021] FIG. 2A is a schematic diagram of a prior art on-axis projection 
25 system; 

[0022] FIG. 2B is a distortion plot that corresponds to the prior art 
projection system of FIG. 2A; 

[0023] FIG. 3A is a schematic diagram of an alternative (off-axis) 
projection system; 

30 [0024] FIG. 3B is a distortion plot that corresponds to the alternative 
projection system of FIG. 3A; 
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[0025] FIG. 4A is a schematic diagram of a two flat mirror folded rear 
projection system; 

[0026] FIGS. 4B, and 4C are distortion plots and focus spot diagrams 
that illustrate the image distortion and focus spot size associated with the two 
5 flat mirror folded rear projection system of FIG. 4A; 

[0027] FIG. 5 is a block diagram of the projection system of the present 
invention; 

[0028] FIG. 6 is a schematic diagram of an example configuration of 
the projection system of FIG. 5 as a two-fold rear projection system that uses 
10 a small aspherical mirror and a corrector lens in sequence; 

[0029] FIGS. 7A-7B illustrate the mold profile from which the small 
aspherical mirror of FIG. 6 is made; 

[0030] FIG. 7C illustrates a mirror surface from which the small 
aspherical mirror of FIG. 6 is cut out; 

1 5 [0031] FIGS. 8A-8C illustrate the surface curvature of the corrector lens 
of FIG. 6; 

[0032] FIG. 9A is a diagram of a distortion-compensated image 
produced by the projection system of the present invention (the lower panel 
shows the image that is generated by a display device and the upper panel 
20 shows the resulting ideal image at the display screen); 

[0033] FIG. 9B is a focus spot diagram of an image of a rectangular 
matrix generated by a display device and seen at the flat mirror; 

[0034] FIG. 1 0A is a schematic diagram of the two-fold rear projection 
system of FIG. 6 using a small aspherical curved mirror alone; 

25 [0035] FIGS. 10B, and 10C are plots that illustrate the image distortion 
and focus spot performance associated with the folded rear projection system 
of FIG. 10A; 

[0036] FIGS. 11 A, and 11B are plots that illustrate the image distortion 
and focus spot performance associated with the folded rear projection system 
30 of FIG. 6; 
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[0037] FIG. 12 is a schematic diagram that illustrates another example 
implementation of the present invention using three mirrors which is adapted 
for vertical projection mounting; 

[0038] FIG. 13 is a schematic diagram that illustrates another example 
5 implementation of a projection system in accordance with the present 
invention which uses three mirrors in which two of the mirrors are curved; 

[0039] FIG. 14A is a schematic diagram that illustrates another 
example implementation of a projection system in accordance with the 
present invention which uses a single, large, curved mirror; 

10 [0040] FIGS. 14B, 14C and 14D are plots that illustrate the image 
distortion and focus spot performance associated with the off-axis, folded rear 
projection system of FIG. 14A; 

[0041] FIG. 15A is a schematic diagram of a single flat mirror prior art 
on-axis projection system; 

15 [0042] FIGS. 15B and 15C are distortion and focus plot diagrams that 
illustrate the distortion inherent in the projection system of FIG. 15A; 

[0043] FIG. 16A is a schematic diagram that illustrates another 
example implementation of a projection system in accordance with the 
present invention which uses a single, large, curved aspherical mirror; 

20 [0044] FIGS. 16B and 16C are distortion and focus plot diagrams that 
illustrate the distortion inherent in the off-axis projection system of FIG. 16A; 

[0045] FIG. 17A is a schematic diagram that illustrates another 
example implementation of a projection system in accordance with the 
present invention which uses a single, large, curved aspherical mirror; 

25 [0046] FIGS. 17B and 17C are distortion and focus plot diagrams that 
illustrate the distortion inherent in the off-axis projection system of FIG. 17A; 

[0047] FIG. 18A is a schematic diagram that illustrates another 
example implementation of a projection system in accordance with the 
present invention which uses a two mirror configuration that includes a 
30 Fresnel mirror substituted for the large, curved, aspherical mirror; 
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[0048] FIG. 18B is a 3D representation of a large, curved mirror 
segment that is converted to the Fresnel mirror used in the embodiment of 
FIG. 18A; 

[0049] FIG. 18C is a distortion plot diagram for the projection system of 
5 FIG. 18A when a corrector lens is not used; 

[0050] FIG. 18D is a 3D profile of an aspherical, rotationally non- 
symmetrical corrector lens used to correct for Fresnel mirror distortions and 
beam-spreading in the projection system of FIG. 18A; 

[0051] FIG. 18E is a distortion plot diagram for the projection system of 
10 FIG. 18A when the corrector lens of FIG. 18D is used without any electronic 
correction; 

[0052] FIG. 18F is a top view of a custom projection lens that can be 

used with the Fresnel mirror of FIG. 18A; 

[0053] FIG. 18G is a side view of the custom projection lens of FIG. 
15 18F; 

[0054] FIG. 19A is a schematic illustration of a prior art projection 
system projecting 30 degrees off-axis upwards, resulting in approximately 
27% keystone distortion; 

[0055] FIG. 19B is a distortion plot that shows 27% keystone distortion 
20 for the projection system of FIG. 19A; 

[0056] FIG. 19C is a schematic diagram that illustrates an prior art off- 
axis projection light engine with a shift between the projection lens and the 
micro-display; 

[0057] FIG. 19D shows the prior art projection light engine of FIG 19B 
25 used in a 30 degree off-axis projection system (note that the lens barrel is 
horizontal but the lens is still projecting an image upwards at 30 degrees; 

[0058] FIG. 19E is a distortion plot for the prior art off-axis projection 
system of FIG. 19D that uses the "shifted lens" projection light engine of FIG. 
1 9C to correct for keystone distortion; 
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[0059] FIG. 20A is a schematic diagram that illustrates a prior art 
projection light engine with a tilt in the projection lens axis in order to take 
advantage of field curvature to minimize de-focusing; 

[0060] FIG. 20B is a schematic illustration of the Scheimpflug principle 
5 (planes of micro-display, lens, and screen all meeting along the same line of 
intersection) being used in a prior art projection system in order to combat 
spot defocus; 

[0061] FIG. 21A is a top view of a custom projection lens that 
incorporates the functionality of the corrector lens; 

10 [0062] FIG. 21 B is a side view of a custom projection lens that 
incorporates the functionality of the corrector lens; 

[0063] FIG. 21 C is a plot of the 3 rd surface (aspherical, asymmetrical) 
from the custom projection lens of FIGS. 21 A-B; and, 

[0064] FIG. 22 is a block diagram of an image processing unit that can 
15 be used with any embodiment of the invention to provide electronic distortion 
correction. 

DETAILED DESCRIPTION OF THE INVENTION 

[0065] Referring now to FIG. 3A, a first attempt at reducing cabinet 
thickness T (see FIG. 2A), could involve reducing the angle a. Accordingly, a 

20 projection system 6" (i.e. an off-axis projection system) is shown having the 
same components as on-axis projection system 6\ however, the planar mirror 
8 is placed at a shallower angle with respect to display surface 20. This has 
the desired effect of reducing cabinet thickness from a thickness of T to a 
thickness of T\ However, the resulting image now has keystone distortion 

25 (see FIG. 3B) in which the image I' produced by the off-axis projection system 
6" is now distorted with respect to the original image I (see FIG. 2B). The 
keystone distortion involves shrinking the image r in the horizontal direction 
near the bottom of the image P while stretching the image P in the horizontal 
direction near the top of the image P. Also, image P is stretched in the vertical 

30 direction. 
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[0066] Referring now to FIG. 4A shown therein is a rear projection 
system 21 that also uses optical path folding to fit the system within a smaller 
cabinet and off-axis mirror placement in order to reduce cabinet thickness. 
Multiple folding using two planar mirrors 33 and 35 allows for a thinner cabinet 

5 size while still accommodating the entire projection path length. As shown, the 
projected image reflects from the secondary flat mirror 35 onto the primary flat 
mirror 33. The primary flat mirror 33 reflects the projected image onto the 
back of the display surface 20 for viewing by viewer 4 on the other side of the 
display surface 20. However, this two flat mirror rear projection configuration 

10 still includes substantial keystone distortion. FIG. 4B illustrates how the 
projected image is undersized at the bottom of the screen, oversized at the 
top of the screen (i.e. projected image 11 does not fit within screen perimeter 
S1) and highly distorted. Specifically, as shown in FIG. 4B, this rear projection 
configuration is associated with a keystone distortion of 65%. Also, FIG. 4C 

15 illustrates how spot size (i.e. de-focus) is approximately 50 mm (far in excess 
of the desired level of 2-3mm) along the top edge of display surface 20. 
Keystone distortion can be somewhat reduced by shifting the micro-display 
down relative to the projection lens 5 in the projection light engine 14 and the 
de-focusing can be reduced by tilting the micro-display relative to the 

20 projection lens 5. This is illustrated in further detail in Figures 19-20. 

[0067] FIGS. 5 and 6 illustrate a projection system 10 built in 
accordance with the present invention. Projection system 10 comprises an 
image processing unit 12, a projection light engine 14, and optical reflection 
assembly 16 which transforms image data representing an input image 
25 provided by image source 18 into a distortion-compensated optical image for 
projection onto a display surface 20 such that the displayed optical image is a 
non-distorted image. 

[0068] Image source 18 can be a video camera, a personal computer, 
or any other device capable of producing an image in the required 
30 video/graphics format (e.g. YPrPb, RGB, DVI, etc.) 

[0069] Image processing unit 12 receives input image data from image 
source 18 and digitally warps, or distortion-compensates, this data to 
compensate for optical distortion in the projection system 10, such that the 
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image displayed on surface 20 is distortion free. Image processing unit 12 
also corrects for any brightness/luminance non-uniformity in the displayed 
optical image. Image processing unit 12 applies electronic correction to the 
digital image data that is provided to the projection light engine 14 thereby 
5 allowing for digital fine-tuning of the data. The specific workings of image 
processing unit 12 will be discussed in more detail. 

[0070] Projection light engine 14 receives the distortion-compensated 
digital image data from image processing unit 12 and generates a 
corresponding distortion-compensated optical image. Projection light engine 

10 14 contains a light generation unit 22, a micro-display 24 and projection optics 
26. The light generation unit 22 (also known as an illumination subsystem) 
includes components (not shown) such as a light source (e.g. an ultra-high 
pressure arc lamp, RGB light emitting diodes or RGB lasers), color separation 
prisms, a parabolic reflector, an integrator rod and/or an integrator/collimator. 

15 The micro-display 24 can be any commercially available micro-djsplay based 
light-modulating subsystem (e.g. a 1 or 3 panel LCD, 1,2, or 3 panel DLP™, 1 
or 3 panel LCOS, etc. including the micro-display specific interface ASICs) 
with an appropriate color management system (i.e. a color wheel, a polarizing 
prism and color select filters, etc.). The micro-display device 24 is used to 

20 generate an optical image by modulating reflected/transmitted light according 
to the distortion-compensated digital image data generated by the image 
processing unit 12. In fact, the illumination subsystem generates a beam of 
light shaped to uniformly illuminate the light-modulating micro-display 
device(s), with color management and/or polarization recovery components 

25 as appropriate. The light-modulating micro-display device(s) are positioned in 
front of the illumination subsystem in order to convert digital image data to an 
optical image. The projection optics 26 consists of lenses that project and 
focus the distortion-compensated image. 

[0071] Projection optics 26 may consist of fixed focal length long-throw 
30 or short-throw lenses, or a variable focal length zoom lens. Also, the 
projection angle of projection optics 26 may be of normal or wide field of view 
(FOV). The invention does not require the projection optics 26 to be distortion 
free as any distortions in projection optics 26 and curved mirrors are corrected 
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by digital image processing. Projection optics 26 may also include a corrector 
lens 49 that is mounted on projection lens 25 and which is accordingly, 
positioned in the optical path of the distortion-compensated optical image 
between the projection lens 25 and optical reflection assembly 16. The 
5 function of the corrector lens 49 will be further discussed. A portion of the 
front edge of projection light engine 14 is represented by reference numeral 
14a. Corrector lens 49 may be eliminated if projection optics 26 is custom 
built as discussed further below. 

[0072] Optical reflection assembly 16 receives the light beam from 

10 projection light engine 14 that consists of a distortion-compensated optical 
image and reflects it onto display surface 20. FIG. 6 shows the specific 
elements of the optical reflection assembly 16 in more detail. As shown, the 
optical reflection assembly 16 consists of an aspherical mirror 39 and a 
primary flat mirror 33. The aspherical mirror 39 is an aspherical asymmetrical 

15 (or rotationally non-symmetrical) curved mirror which is used in association 
with primary flat mirror 33 to fold the optical path. Such a mirror is the most 
effective and direct way to compensate for severe keystone distortion (the 
kind that is encountered at high DtoD ratios) because the keystone distortion 
itself is asymmetrical. In keystone distortion, there is different magnification of 

20 the image at the top of the image relative to the bottom of the image. Prior art 
methods are restricted in the amount of keystone distortion correction (and 
hence DtoD ratios improvement) because the prior art methods only use 
micro-display offset to correct for keystone distortion and symmetric 
mirrors/lenses because of the requirement that all distortion must be 

25 corrected with optical means. The primary purpose of the aspherical mirror 39 
is to reduce distortion due to off-axis projection and allow use of all the 
available micro-display pixels and light from the illumination source. The 
aspherical mirror 39 can also be used in projection systems that apply micro- 
display shift to correct for any left-over distortion that is not corrected by the 

30 micro-display shift. As discussed above, corrector lens 49 of projection optics 
26 is positioned in the optical path of the distortion-compensated optical 
image between the projection lens 25 and the aspherical mirror 39 to correct 
for beam width divergence and to control associated de-focusing distortion, as 
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will be discussed. Corrector lens 49 is also an aspherically curved, rotationally 
non-symmetric lens. 

[0073] The display surface 20 is designed to receive light at high and 
varied angles of incidence and to either reflect or transmit light perpendicular 
5 to the display surface 20. The display surface 20 is reflective in a front 
projection system or transmissive in a rear projection system. In a 
conventional rear projection system, a Fresnel lens is used to receive the light 
impinging onto the display surface 20 at a non-perpendicular angle and 
change its direction to exit normally through the plane of the display surface 
10 20 towards the viewer, or, in other words, to collimate the light. In a 
conventional rear-projection system, the center of the Fresnel lens will be at 
the center of the display surface and there is a radially symmetric distribution 
of incidence angles on the display surface. 

[0074] In an RP (rear-projection) off-axis system designed according to 

15 this invention, a Fresnel lens will be needed as well, but it must deal with an 
asymmetrical distribution of angles of incidence of light striking the display 
surface, because of the off-axis projection geometry. This forces the center of 
the Fresnel lens to be considerably offset downwards from the center of the 
display surface, the degree of offset being dependent on the DtoD ratio of the 

20 system (amount of off-axis geometry being used). Thus, Fresnel lenses that 
are used in off-axis projection systems are not symmetrical. These 
asymmetrical Fresnel lenses must be designed to collimate light from a much 
larger cone of projected light that includes, in particular, the off-axis light path 
being designed for. In fact, In systems with a higher DtoD ratio, the projection 

25 axis is more inclined, requiring more keystone distortion to be corrected. This 
means that a wider cone of light emanates from the micro-display with a 
larger spread of incident light angles between the bottom and top of the 
display surface. The optical axis of this cone of light must pass through the 
center of the Fresnel lens, and the center of the Fresnel lens becomes offset 

30 downwards to a greater degree in order to satisfy this optical requirement. In 
a projection system with an extreme off-axis configuration, the optical center 
of the Fresnel might be off the screen entirely. Consequently, the diameter of 
the Fresnel lens will be much bigger than the screen diagonal, and a 
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rectangular piece is cut out of it to be laminated with the screen. Obviously, if 
only one usable Fresnel lens segment can be extracted from the larger 
diameter structure, the cost of the lens is higher. In some asymmetrical 
Fresnel lens designs, more than one usable lens segment may be cut out of 
5 the basic large diameter complete Fresnel lens, helping to amortize the cost 
of machining the molds that are used to make the Fresnel lenses. 

[0075] FIG. 7A-7C illustrates the surface curvature of the aspherical 
mirror 39 of FIG. 6. The aspherical mirror 39 has been introduced to correct 
for the keystone distortion which results from the off-axis nature of the 

10 projection system 10. The aspherical mirror 39 is designed based on the 
knowledge that reflection of an image from a concave surface will shrink the 
image and reflection of an image from a convex surface will expand the 
image. For example, in Fig 3B, the image has expanded horizontally beyond 
the width of the display surface at the top of the display surface. In addition, 

15 the image has horizontally shrunk to less than the width of the display surface 
at the bottom of the display surface. A mirror with a concave upper portion 
could shrink the image to fit on the display surface, while the same mirror, if it 
had a convex lower portion, could expand the image to fit at the bottom of the 
display surface. In practice, with an off-axis projection scheme, it is preferable 

20 to move the projection system a little closer to the display surface so that the 
top part of the image becomes less than or equal to the horizontal display 
surface width, and adjust the mirror shape accordingly. This has the double 
benefit of reducing the projection distance (which can lead to less cabinet 
thickness in a folded geometry configuration) and an easier mirror profile to 

25 fabricate since the mirror is convex-only, instead of having a concave-to- 
convex transition. In reducing the projection length, the lens of the projection 
light engine becomes more of a wide-angle lens which is harder to design and 
has more spherical aberrations that need to be corrected. Consequently, it is 
beneficial to iteratively try several different combinations of projection length, 

30 projection lens and curvature of the aspherical mirror 39 in order to determine 
the optimal configuration. 

[0076] Accordingly, the aspherical mirror 39 of the present invention is 
designed with a mild horizontally convex upper portion to produce a very 
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slight horizontal enlarging effect (i.e. the projection path has been shortened) 
at the top of the display surface 20 and a horizontally more convex lower 
portion to horizontally enlarge the bottom of the display surface 20 to a 
greater degree. The aspherical mirror 39 is also vertically concave to 

5 compensate for the vertical stretching of keystone distortion. Accordingly, the 
aspherical mirror 39 has a vertically oriented concave surface and a 
horizontally oriented surface which varies from being more convex to flat or 
less convex. For clarity, FIG. 7A shows the curvature in the horizontal 
direction of the mold from which aspherical mirror 39 will be made and FIG. 

10 7B shows the curvature in the vertical direction of the aspherical mirror 39 
mold. FIG. 7C shows a perspective view of the curvature of the aspherical 
mirror 39 with the horizontal direction shown extending into the page (i.e. 
along the Y-axis), the vertical direction extending from left to right and the 
height (or thickness) of the curvature represented by the z axis. The actual 

15 active area of the mirror is smaller than shown in FIG. 7C, but the plot is 
useful for seeing the effect of changing the coefficients that describe the 
surface profile of the aspherical mirror 39. The horizontal radius of curvature 
of the aspherical mirror 39 transitions from a large positive value at the top 
(i.e. low curvature), to a smaller positive value (i.e. more curvature) at the 

20 bottom. The vertical radius of curvature is selected to correct for vertical 
scaling errors that are caused due to keystone distortion. 

[0077] The overall shape of the aspherical mirror 39 is determined by 
initial and final radii and the rate of transition, and from the foregoing 
description, clearly is rotationally non-symmetric, though it is laterally 

25 symmetric about a vertical axis. The specific surface profile of the aspherical 
mirror 39 is chosen by trading off the corresponding projection lens design, 
the desired distortion to be corrected by electronic means, the desired 
effective display resolution and the cabinet depth. Accordingly, it is possible 
that an aspherical mirror could be designed that is vertically concave, and has 

30 a horizontal curvature that varies from being concave in the upper portion of 
the mirror, to flat, to convex along the lower portion of the mirror. For 
example, a rear projection television (RPTV) manufacturer who wishes to use 
the same projection lens being used in a conventionally configured system 
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would need a corrector lens and due to constraints imposed by the physical 
dimensions of the existing projection lens might choose a different diagonal to 
depth ratio (and cabinet depth) than another RPTV manufacturer who is 
willing to design a new projection lens for this application. Another example 
5 would be an RPTV manufacturer with an inventory of flat mirrors that might 
constrain the dimensions of the cabinet, and thus, indirectly, the prescription 
of the aspherical mirror 39. 

[0078] If the cabinet depth is reduced, the angle between the 
aspherical mirror 39 and the projection lens 5 becomes shallower, leading to 

10 increased keystone distortion which needs to be corrected. Consequently, the 
curvatures of the aspherical mirror 39 need to become more extreme, as they 
need to correct more severe upper horizontal expansion and more severe 
lower horizontal contraction and more severe vertical expansion. The 
aspherical mirror 39 becomes larger and thicker in order to accommodate a 

15 larger amount of curvature. In this case, the corrector lens 49 is also modified 
to incorporate more of a curvature to correct for the added de-focusing effect 
that is produced due to the increased curvature of the aspherical mirror 39. 

[0079] The aspherical mirror 39 can partially or fully correct for 
keystone distortion in an off-axis projection system. In such a system, flat 

20 mirrors offer no correction. Decreased keystone distortion is achieved by 
using the convex surface portion of the aspherical mirror 39 to magnify the 
image (horizontally to a greater or lesser degree) and the concave surface 
portion of the mirror to shrink the image vertically. By smoothly varying the 
sign (convex or concave) and magnitude of the curvature, the keystone- 

25 shaped distortion plot is converted to a more or less rectangular distortion 
plot. If the aspherical mirror 39 and corrector lens 49 are properly designed 
together, it is much easier for the image processing unit 12 to maintain 
quality (i.e. brightness and focus) of the pixels near the edges of the display 
surface 20. However, the aspherical mirror 39 also leads to the compounding 

30 of field curvature issues, namely spot size/focus problems wherein the center 
of the image has a reasonable MTF and focus, but the edges of the image 
experience de-focusing and a reduced MTF. 
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[0080] FIGS. 8A-8C illustrate the surface curvature of the corrector lens 
49 of FIG. 6 that is used (along with shifting and tilting the micro-display 
device 24 relative to projection lens 25 or vice-versa) to decrease the de- 
focusing (i.e. beam spreading) of the light beam projected by projection lens 5 

5 onto the aspherical mirror 39. The corrector lens 49 is also an aspherically 
curved, non-rotationally symmetric lens that corresponds to the curvature of 
the aspherical mirror 39, and is designed for use with the projector lens 5 that 
is being used in the projection system 10. Specifically, the corrector lens 49 is 
designed to be positioned in front of the projector lens 5, as shown in FIG. 6. 

10 FIG. 8A shows the curvature of the corrector lens 49 in the horizontal 
direction and FIGS 8B shows the curvature of the corrector lens 49 in the 
vertical direction. FIG. 8C shows a perspective view of the curvature of the 
corrector lens 39 with the horizontal direction shown left to right, the vertical 
direction extending into the page (i.e. along the Y-axis) and the height (or 

15 thickness) of the curvature represented by the z axis. The shape of the 
corrector lens 49 is similar to the shape of the aspherical mirror 39 and will 
also be rotationally non-symmetric and laterally symmetric about the vertical 
axis. In particular, the corrector lens 49 is a horizontally convex cylindrical 
lens that transitions from a smaller radius of curvature to a larger one and 

20 also has a vertical concave shape. However, the corrector lens 49 is flatter 
(i.e. has larger radii of curvature in both horizontal and vertical directions. 

[0081] The corrector lens 49 is formed with larger radii of curvature 
than the aspherical mirror 39 and corrects for beam-width spreading and 
compensates for the characteristics of the projection lens 5. The use of the 

25 corrector lens 49 also allows the possibility of currently available projection 
lenses 5 to be adapted for use (i.e. retrofitted) within the projection system 10 
of the present invention providing the currently available projection lens 5 
meets with minimum performance and dimensional criteria (i.e. lens speed, 
MTF, ability to fit within smaller enclosures, etc). Custom projection lenses for 

30 the system, which will be described in further detail, can be developed that 
include the corrector lens capability, thus eliminating the need for a separate 
corrector lens component and ensuring proper fit. Also, it should be 
understood that image processing unit 12 is used to provide electronic 
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correction that corrects for the combination of remaining uncorrected 
distortion due to the projection lens 5, the corrector lens 49, the aspherical 
mirror 39, the off-axis projection geometry, and installation misalignments. 
Accordingly, the image processing unit 12 provides an additional degree of 
5 freedom that can compensate for any physical inaccuracies or misalignments 
in the projection system 10. 

[0082] With respect to FIGS. 6-8, exemplary dimensions for the various 
components will now be given. For the corrector lens 49, the first surface sag 
is 4.58 mm, the second surface is piano and the distance from the last lens 

10 surface in the projection lens is 1 1 mm (center ray). For the curved mirror 39, 
the mirror sag is 33.5 mm, the tilt angle is -46.4 degrees, the distance from 
the last corrector lens surface in the projection lens is 201.7239 mm (center 
ray) and the X,Y corner coordinates, in mm, are: (295.528198, 276.941671), 
(141,557812, -87,435980), (-141.557812, -87.435980) and (-295.528198, 

15 276.941671). For the mirror 33, the tilt angle is +51.2 degrees, the distance 
from the curved mirror 39 is 298.775 mm (center ray) and the X,Y corner 
coordinates in mm are: (713.058886, 579.509103), (611.018382, - 
235.682721), (-611.018382, -235.682721) and (-713.058886, 579.509103). 
For the display surface 20, the tilt angle is 0 degrees, the distance from the 

20 mirror 33 is 384.2278 mm (center ray) and the size is 1480mm wide by 834 
mm high with a 1702 mm diagonal. 

[0083] Referring now to FIG. 9B, shown therein is a focus spot diagram 
of an image on the flat mirror 33. The image was a rectangular 5x7 matrix of 
points that was generated by the micro-display device 24, and projected by 

25 the projection light engine 14 through the corrector lens 49 and the aspherical 
mirror 39. Increasing the degree of convex curvature near the bottom of the 
aspherical mirror 39 will cause the points to spread out near the bottom of 
FIG. 9B while increasing the degree of concave curvature near the top of the 
aspherical mirror 39 will cause the points to compress near the top of FIG. 9B. 

30 It should be noted that FIG. 9B shows focus spot behavior without any effects 
from electronic correction. 

[0084] The curvature of the aspherical mirror 39 attempts to correct for 
the keystone distortion and, as seen at the surface of the flat mirror 33, there 
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is an improvement in distortion reduction. The focus spot diagram shows that 
there is still a slight keystone effect as well as a de-focusing effect for the 
points near the edge of the image. This slight keystone effect can be 
corrected by placing the display surface 20 at a certain distance from the flat 
5 mirror 33. However, if the display surface 20 is placed at a larger distance 
away from the flat mirror 33 then reverse keystone distortion and increased 
de-focusing occurs. However, another approach to correcting this slight 
keystone effect can be through electronic means as will now be described. 

[0085] Now referring to FIGS. 5, 6, and 9A, the image processing unit 
10 12 is used to geometrically apply distortion compensation to an input digital 
image in such a manner that the displayed optical image is distortion-free. 

[0086] Specifically, FIG. 9A provides an example of a distorted image 
40 that results from the reflection of an ideal image 44 in a curved mirror such 
as the aspherical mirror 39. While the aspherical mirror 39 corrects for the 

15 keystone distortion, there is still some residual distortion that is to be 
corrected. Also shown is a distortion-compensated image 42 that, when 
reflected in a curved mirror, will correct or compensate for the distortion 
caused by the curved mirror and result in the ideal image 44 being projected 
on the display surface 20. That is, when the distortion-compensated image 42 

20 is reflected in a curved mirror, the ideal image 44 will be projected on the 
display surface 20. Specifically, in the absence of any correction, the ideal 
image ABCD will be displayed on the display surface 20 as the curved 
"trapezoid" EFGH with the corner/boundaries mapped as shown. By 
compensating the image in the inverse manner, as shown by the "trapezoid" 

25 UKL, the final image displayed will match exactly the screen/ideal image 
ABCD and accordingly, be distortion free. 

[0087] Accordingly, the projection system 10 uses the image 
processing unit 12 to distortion-compensate the input image according to 
geometric transformations that are the inverse of the geometric distortions 
30 (not shown) introduced by the projection light engine 14 and the associated 
reflection (mirror) optics (not shown). If the full distortion achieved within 
projection system 10 (due to lenses/mirrors) is represented by the 
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transformation F, then the image is distortion-compensated according to F 1 , 
and the following relation exists: 

Displayed Image = (Input Image)) = Input Image 2) 

[0088] Accordingly, the image processing unit 12 essentially "frees" the 
system of constraints associated with the requirements for a distortion-free 

5 displayed image. The ability to digitally correct distortions means that the 
optical geometry and the optical elements (such as angles, types of the 
mirror(s) and lenses, whether the curved mirror is rotationally non-symmetric 
or not, etc.) can be varied as needed for particular design objectives. Without 
geometric correction provided by the image processing unit 12, distortions 

10 within the displayed image will result due to the various optical processing 
steps. The distortion compensation applied by the image processing unit 12 is 
essentially a re-sampling/filtering of the input image data. The pixels are re- 
sampled according to F"\ which gives the geometric transformation that the 
pixel positions undergo. The transformation F" 1 can be determined from the 

15 spatial transforming properties of the various optical elements. The specifics 
of the image processing unit 12, will determine the format in which F' 1 needs 
to be specified (e.g. in terms of 2D surfaces, 1D polynomials, etc.). 

[0089] The image processing unit 12 is also used to correct for 
brightness or luminance non-uniformity. The displayed image on the display 

20 surface 20 may have brightness variations due to limitations of the projection 
light engine components (e.g. light generation unit, lens vignetting, etc.) or 
due to properties of the optical path. In particular, points or sections 
illuminated on the display surface 20 are illuminated by light that travels 
different distances from the projection lens, considering the entire path 

25 including reflections and corrector lens refraction. Since the intensity of light 
falling on a point or section of the displayed image varies inversely with the 
square of the distance traveled by the light, this leads to brightness variations 
within the displayed image. In an off-axis projection system, there are more 
pronounced differences in the path length traversed by light rays impinging at 

30 the top of the screen versus the bottom of the screen. Consequently, the 
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brightness variations are greater for an off-axis projection system rather than 
an on-axis projection system. 

[0090] The image processing unit 12 is used to pre-adjust the pixel 
brightness, prior to projection, so that the final image can be displayed with 
5 uniform brightness. The pixel brightness is pre-adjusted in color space 
according to a pre-determined map, say G"\ similar to F 1 and provides the 
locations of the pixels in the display surface 20. This map only acts in the 
color space and no additional filtering is needed (i.e. only the pixel color 
values, not the pixel positions, are adjusted). As for F" 1 , G" 1 can be 

10 determined from the brightness/luminosity transforming properties of the 
various optical elements and optical patch. The image processing unit 12 will 
apply G" 1 to each pixel's color value. A simple case is given by a linear 
function: G~\0)=aO + p , where O is an RGB color value and the functional 
parameters a and p are constant for every pixel. The electronic correction of 

15 projection system 10 allows for a more flexible choice of optical lenses, since 
any associated distortions will be eliminated by pre-warping, rather than by 
matching the optical properties of the lenses. In particular, wide-angle lenses 
can be used, which can project the same sized image, but at shorter 
projection distances, hence providing another variable in reducing the throw 

20 ratio. Note that focus problems (as opposed to geometrical problems) cannot 
be corrected by geometric distortion compensation and still need to be 
addressed optically by appropriate choice of lenses. 

[0091] Without the general electronic geometry correction achieved by 
the image processing unit 12, the projection system 10 must be designed to 

25 ensure that the overall image distortion is acceptable. Such design constraints 
can be problematic, due to distorting effects of the curved mirror, the off-axis 
projection (keystone effects), and wide-angle lens. The present invention's 
use of electronic correction allows for geometric distortion (as well as 
brightness non-uniformity) to be eliminated from the design constraints for a 

30 projection system and instead these prior limitations can be considered to be 
a design "degree of freedom". Accordingly, the image distortion of the optical 
path can be freely modified in order to improve other aberrations. Further, 
digital correction (via distortion-compensation) of the input signal can be used 
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to compensate for this, and thus an undistorted image can be produced on 
the viewing screen. 

[0092] It should be noted that by providing three independent image 
processing units, each acting on a specific passband of light, for example, R, 

5 G, and B, the distortion compensation characteristics for each of these 
passbands may be individually adjusted. This allows for the correction of 
problems such as lateral color shift or chromatic aberrations which are due to 
optical effects, for example, refractive index, which have different values for 
different wavelengths of light. In order to take advantage of this technique, 

10 means must be provided to separate the passbands of interest (color 
bandpass filters, for example) at the light source, so that the light modulators 
are subject to specific compensatory processing that is synchronized to the 
separate passbands of light being modulated by them. Both field-sequential 
or 3-panel parallel light-modulation schemes are amenable to this approach. 

15 Schemes that use more than 3 colors in their color space may be similarly 
treated. This approach trades off electronics costs against optics and 
alignment costs and promises to be increasingly cost-effective since 
processing costs are continually dropping but optics and labor costs (involved 
in alignment) are increasing. If luminance compensation is also applied for 

20 each passband, then the spectral characteristics of the illumination source 
(e.g. high intensity discharge light using ultra high pressure gases and small 
arcs, for example) can be adjusted to have more desirable characteristics 
(more uniform instead of exhibiting peaks, for example). 

[0093] Using a curved mirror for reflection results in a screen image 
25 that is still distorted according to a combination of a reduced keystone effect 
and pincushion/barrel type effects. Accordingly it is extremely difficult to 
compensate for these types of distortions simply by selective arrangement of 
the optical elements. With the electronic geometric correction of projection 
system 10, these distortions can be eliminated. Referring back to FIG. 9A, an 
30 example of a distorted screen image 40 that might arise due to reflection of a 
curved mirror and the corresponding distortion-compensated image 42 that 
will serve to correct the geometric distortion is shown. However, the benefit of 
using a curved mirror within the reflection optics assembly 16 is that keystone 



-25- 



distortion can be reduced while preserving the use of most or all of the 
available pixels in the micro-display. 

[0094] Now referring back to FIGS. 5 and 6, the image source 18 
provides the image processing unit 12 with digital input image data, which is 
5 then processed by the image processing unit 12 until an appropriate 
distortion-compensated image is generated. The distortion-compensated 
digital image data is then provided to the projection light engine 14 for light 
modulation and subsequent projection by the projector lens 5 at point P into 
the optical reflection assembly 16. The distortion-compensated optical image 

10 gets distorted in the lens (from spherical aberrations, and the like as well as 
lens shift and/or tilt as is described later on) and then is reflected first by the 
aspheric mirror 39, but the keystone distortion from the off-axis angle fills the 
image out properly and the distortions from reflecting off the curved surface 
perform the final corrections of the image so that after the image gets past the 

15 primary flat mirror 33 of the optical reflection assembly 16 onto the display 
surface 20 for viewing by the viewer 4, it looks undistorted. 

[0095] The projection light engine 14 accepts the distortion- 
compensated digital image data from the image processing unit 12 and 
generates a modulated beam of light that passes through the corrector lens' 

20 49 that is used to decrease the de-focusing that is introduced by the 
aspherical mirror 39. The corrector lens 49 corrects for beam-width spreading 
due to the characteristics of the projection lens 5 and the aspherical mirror 39. 
Once the projected image passes through the corrector lens 49, it strikes the 
aspherical mirror 39 and is reflected by it. The reflected image then strikes the 

25 primary flat mirror 33 (running from A to B) that reflects the distortion 
compensated image onto the display surface 20 (running from E to F). Since 
the aspherical mirror 39 gradually changes from a more convex cylindrical 
surface to a less convex cylindrical surface, the projected image provided to 
the primary flat mirror 33 is partially corrected for the effects of keystone 

30 distortion, namely, the variation of horizontal scaling from the top of the 
display surface to the bottom of the display surface. In addition, the concave 
vertical curvature of the aspherical mirror 39 partially corrects for the vertical 
expansion of the image due to keystone distortion. The partial distortion 
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correction of the aspherical mirror 39 is not a problem because the image 
processing unit 12 provides electronic correction to compensate for the 
remaining distortion as well as any mis-alignments. This is in contrast to prior 
art systems in which electronic means for mis-alignment correction are not 
5 used. Rather, the prior art uses elaborate optical, mechanical, and thermal 
techniques to ensure correct alignment at initial assembly and continued 
alignment even under mechanical vibration and temperature variations. 

[0096] The four points and the trapezoid they define on primary flat 
screen 33 must then be reflected in a manner such that the area enclosed by 

10 the "trapezoid" (now curved because of reflection from a curved surface) in 
the plane of the screen fully encloses the screen on the display surface 20 (as 
shown in FIG. 9A where the trapezoid EFGH fully encloses the screen 
ABCD). This ensures that after electronic correction by the image processing 
unit 12, the displayed image covers exactly the rectangular screen on display 

15 surface 20. 

[0097] Another approach may be to design the light-modulating display 
device of the projection light engine 14 with pixels shaped to fit a pre-defined 
distortion-dependent shape which maintains full resolution at the screen after 
the light traverses the complete optical path. The shape is such that, after the 

20 light beam impinging on the micro-display device has been modulated, the 
light beam passes through the projection lens, reflects from the curved mirror 
and strikes the display surface with the proper aspect ratio, overlaying the 
entire rectangular extent of the display surface. For optimal use of available 
light, the light beam impinging on the micro-display can be shaped to conform 

25 to the shape of the micro-display. This can be achieved by using total internal 
reflection integrator rods that are shaped similar to the micro-display surface, 
for example. 

[0098] For illustrative purposes, the importance of the corrector lens 49 
within the projection system 10 of the present invention can be seen from a 
30 performance comparison between the projection system 10 and a similar 
projection system 100 (both systems use conventional projection lenses), the 
only difference being the absence of corrector lens 49. The projection system 
100 is shown in FIG. 10A and the various performance results are illustrated 
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in FIGS. 10B, and 10C. Specifically, it can be seen that without the use of the 
corrector lens 49, while the distortion plot (see FIG. 10B) shows relatively 
reasonable levels of keystone distortion (due to the use of the aspherical 
mirror 39), FIG. 10C shows that de-focusing is severe. Specifically, FIG. 10C 

5 illustrates how the focus spots are approximately 5mm (5 pixel spans) at the 
center of the display surface 20 area and that they are approximately 30mm 
(30 pixel spans) at the edges of the perimeter of the display surface 20. The 
focus spot size exceeds 20 mm at the perimeter edges of the display surface 
20 which does not meet the focus spot size requirements for typical projection 

10 systems. In this case, a projection lens can be designed to include the 
properties of the corrector lens 49. Electronic correction was not used for 
FIGS. 10B and 10C. 

[0099] In contrast, as shown in FIGS. 11 A, and 1 1 B, the performance 
of projection system 10 is notably superior when the corrector lens 49 is 

15 introduced and positioned in front of the projector lens 5. Specifically, it can 
be seen from FIG. 1 1 B that the focus spots are all less than 4mm (4 pixel 
spans) throughout the screen projection area as required for acceptable 
performance. In fact, the focus spot sizes are in the 2 to 5 mm range. It 
should be noted, however, as shown in FIG. 11 A, a small amount of 

20 additional keystone distortion has been re-introduced by the corrector lens 49. 
This minor amount of distortion can be reduced by another design iteration. 
Specifically, the surface of the aspherical mirror 39 can be re-optimized for 
the presence of the corrector lens 49, and the corrector lens 49 can be also 
re-optimized using the newly iterated prescription of the aspherical mirror 39. 

25 Electronic correction was not used for FIGS. 1 1 A and 1 1 B. 

[00100] Alternatively, the corrector lens 49 is not required if the 
projection lens of the projection light engine is designed to account for the 
aspherical mirror 39 as previously mentioned. This is accomplished by 
applying the surface profile of the corrector lens 49 to one of the already 
30 existing lens elements of the projection light engine. A preferable candidate is 
an existing plastic molded aspherical lens element. This will not give a perfect 
solution by itself, but will give a good first-order approximation for the desired 



-28- 



surface profile. Further optimization can yield a custom projection lens that is 
better than the combination of an existing lens combined with a corrector lens. 

[00101] Referring now to FIG. 12, shown therein is an alternate 
projection system 200 which incorporates three mirrors; the primary flat mirror 

5 33 and aspherical mirror 39 of system 10 as well as an additional secondary 
flat mirror 202. The aspherical mirror 39 and the secondary mirror 202 are 
both small mirrors. The projection system 200 allows for a more vertical 
placement of the projection light engine 14, exchanging a little extra height for 
more flexibility in choosing the mounting of the projection light engine 14 or 

10 the projection lens 5 in the cabinet that houses the projection system to 
provide a reduced cabinet depth. In some designs, the projection light engine 
14 might be positioned horizontally, with a mirror used to rotate the image by 
90 degrees in order to attain some flexibility in placement. In such a design, 
the image also needs to be digitally pre-rotated 90 degrees. This is because 

15 the light modulator (a digital micro-mirror device, or an LCOS panel, or an 
LCD panel, for example) is typically fabricated with a 4:3 or 16:9 aspect ratio, 
that is, in a rectangular aspect ratio. When a mirror is used to rotate the light 
beam by 90 degrees, the image being sent to the light modulator should also 
be rotated in order to fully use the entire area of the micro-display. 

20 [00102] In an alternative embodiment, a projection system in 
accordance with the present invention may comprise a single large flat mirror, 
and two curved mirrors, where one of the curved mirrors is a simple bent 
section that can be made, for example, by taking a section of a cylinder that 
could be made of plastic, bending it over a mandrel, and coating it with 

25 sputtered aluminum to give it appropriate reflecting properties. The other 
curved mirror is a smaller aspherical mirror that performs the rest of the 
keystone correction. Referring now to FIG. 13, shown therein is a projection 
system 300 which comprises a projection light engine 14 with a corrector lens 
49, curved mirrors 302 and 304, primary large flat mirror 33, display surface 

30 20 and the image processing unit 12 (not shown). The use of the image 
processing unit 12 allows for potentially very inexpensive mirrors to be used 
for the curved mirrors 302 and 304. The projection system 300 also has the 
other system components of projection system 10 (shown in FIG. 5) except 
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that the optical reflection assembly now comprises three mirrors with two of 
those mirrors being curved. 

[00103] The curved mirror 302 is an aspherical mirror similar to the 
aspherical mirror 39 of Figure 12, except that it is smaller in size. The 
5 curvatures for the curved mirror 302 and the aspherical mirror 39 are similar 
vertically. Accordingly, curved mirror 302 is also aspherical. However, there is 
less horizontal convex curvature both at the bottom of mirror 302 as well as at 
the top of mirror 302. This is due to the additional beam expansion caused by 
the curvature of curved mirror 304 which is a simple curved mirror. The 
10 curvature of curved mirror 304 may be defined by a section of a cone with 
more curvature occurring near the bottom of the mirror 304 and less curvature 
near the top of the mirror 304. Alternatively, the curved mirror 304 may also 
have some curvature in the vertical direction. 

[00104] The use of two curved mirrors is beneficial since the total 
15 curvature necessary for keystone correction by the aspherical mirror 39 can 
now be separated and provided by two smaller curved mirrors. A smaller 
aspherical mirror can be produced more economically since a smaller 
aspherical mirror requires less machining time for either the mirror itself, or 
the mold from which the mirror would be mass-produced via a plastic injection 
20 process. Accordingly, the fabrication of the two curved mirrors may possibly 
be more economically achieved compared to the costs required to fabricate 
than a single more complex aspherical mirror. Modern optic design tools 
permit for simulating a variety of configurations of the two curved mirrors 302 
and 304. Accordingly, the final choice of curvatures can depend on fabrication 
25 tradeoffs. 

[00105] The previous embodiments of this invention have shown the use 
of small, curved mirrors. Another alternative embodiment of an off-axis 
projection system in accordance with the present invention uses a single large 
curved mirror. The general shape of the large curved mirror and the smaller 
30 curved mirror are similar. However, the radii of curvature for the smaller 
curved mirrors are smaller than those of the large curved mirror. The large 
curved mirror will typically have the same vertical dimension as the display 
surface while the horizontal dimension of the large curved mirror will be the 
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same as that of the display surface near the top of the large curved mirror and 
slightly less than that of the display surface near the bottom of the large 
curved mirror. The large curved mirror will be the mirror closest to the display 
surface and if there is another mirror in the configuration, it can be a fold 

5 mirror which is situated close to the projection light engine. The fold mirror will 
be smaller the closer that it is to the projection light engine. An advantage of 
the embodiment with a large curved mirror is that the curved mirror is closer 
to the display surface and defocusing can be better controlled because the 
light bouncing from the curved surface has a much shorter distance to go 

1 0 before striking the display surface. 

[00106] Referring now to Figure 14, shown therein is a projection system 
300 having a projection light engine 14, a single curved mirror 402 and a 
display surface 20. The single curved mirror 402 is approximately the same 
size as the display surface 20. The projection system 402 comprises the 

15 same components as the projection system 10 (see FIG. 5). However, the 
optical reflection assembly comprises only the single curved mirror 402. As 
before, a custom projection lens may be designed for this application to 
correct for the beam-spreading defocus of the single curved mirror 402. As 
before, the off-axis projection, and the distortion correction performed by the 

20 combination of lens and mirror profile design and image processing, allows 
the cabinet thickness to be reduced. Because the defocusing can be better 
controlled with a large, curved mirror, more severe off-axis geometry can be 
used, resulting in increased improvements to DtoD ratio and cabinet 
thickness. 

25 [00107] The surface profile of the single large curved mirror 402 is 
similar to that used for the small curved mirror approach, that is, the profile of 
the single large curved mirror 402 is aspherical, rotationally non-symmetrical, 
and laterally symmetrical. The single, large, curved mirror 402 has a concave 
surface that is oriented vertically. Accordingly, the curved mirror 402 shrinks 

30 the image slightly in the vertical direction, to compensate for vertical off-axis 
expansion. The single curved mirror 402 introduces distortion that is handled 
by a combination of the projector lens/corrector lens and the image 
processing unit 12 (not shown). If a corrector lens is not used then a custom 
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designed projection lens (not shown) must be used. The custom designed 
projection lens will be a multi-element lens system which also provides the 
functionality of the corrector lens. The custom designed projection lens can 
include shift and tilt techniques in order to alleviate some of the distortion and 
5 focus control needed. 

[00108] Referring now to FIGS. 14B-14D, shown therein are distortion 
plots and focus spot diagrams for the projection system 400 of FIG14A. FIG 
14B shows the distortion correction performed by the large curved mirror, 
which is clearly quite good, almost making full use of all the available pixels. 

10 FIG 14C shows the focus spot diagrams without a corrector lens element and 
FIG 14D shows the focus spot diagram with a corrector lens element. In these 
results, the projection system 400 has a 60 inch diagonal display screen and 
a cabinet depth of 1 1 inches. The sag of the mirror 402 was 40 mm, or about 
1.5 inches. If FIGS. 14B and 14D are compared with the conventional on-axis 

15 performance illustrated in FIGS. 1C and 1D, one can see that the large, 
curved mirror technique can yield image quality that almost does not require 
any image processing to correct for residual correction, using off-the-shelf 
lenses with correction. This also implies that by using a more advanced 
custom lens designs and using other techniques such as tilt, offset, and 

20 image processing, more gains in DtoD ratios and cabinet depth reductions 
may be realized. Electronic correction was not used for FIGS 14B-D. 

[00109] The following paragraphs will go through a step-by-step 
explanation of how succeedingly better DtoD ratios can be achieved by 
applying increasingly sophisticated techniques. Referring now to FIG. 15A, 

25 shown therein is a portion of an example of a prior art on-axis rear projection 
system 500 which comprises a projection light engine 14, a single flat mirror 
502 and a display surface 20. The system has a 90 degree screen projection 
angle. FIGS. 15B and 15C show the distortion and focus plot diagrams 
respectively. The projection system 500 does not add significant distortion or 

30 de-focusing. The cabinet thickness T1 is approximately 19 inches thick for a 
screen diagonal of 67 inches, with a DtoD ratio of 3.52. The focus spots are 
all between 0.5 and 1.5 mm. Electronic correction was not used for FIGS. 
15A-B. 
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[00110] Referring now to FIG. 16A, shown therein is a portion of an off- 
axis projection system 600, in accordance with the present invention, 
comprising projection light engine 14, display surface 20 and a single curved 
mirror 602. The single curved mirror 602 is an aspherical mirror which is 
5 similar to that shown in FIGS 7A-7C. The curved mirror 602 has a sag of 
approximately 30 mm (which is the distance between a plane that is 
perpendicular to the mid-point of the mirror 602 and a plane that is 
perpendicular to the edges of the mirror 602). FIGS. 16B and 16C show the 
distortion and focus plot diagrams respectively. The projection system 600 fills 

10 the top of the display surface but not the bottom. The cabinet thickness T2 is 
about 16 inches thick with the same 67" diagonal as before, for a DtoD ratio of 
4.2. The keystone distortion is reduced with the single curved mirror 602, but 
there is still some residual 'warping* of individual lines as shown in FIG. 16B. 
The distortion with the single curved mirror 602 is reduced to about 7%. A 

15 distortion value of 5% (corresponding to a loss of about 5% of the available 
pixels) is considered acceptable. The 7% distortion can be easily handled by 
the image processing unit 12 and could be corrected back down to less than 
1% but would still result in a loss of approximately 7% of the available pixels. 
This distortion can also be improved with further optimization. Furthermore, a 

20 corrector lens is not being used and a slight de-focusing has been removed 
by tilting the projection lens of the projection light engine 14 approximately 0.2 
degrees. The resulting spots in FIG. 16C are between 0.5 and 1.5 mm which 
are the same as those shown in FIG. 15C. Electronic correction was not used 
for FIGS. 16B-C. 

25 [00111] Referring now to FIG. 17A, shown therein is a portion of an off- 
axis projection system 700, in accordance with the present invention, 
comprising a projection light engine 14, a display surface 20 and a single 
curved mirror 702. The single curved mirror 702 is an aspherical mirror which 
has a sag of approximately 70 mm (defined as explained above). FIGS. 17B 

30 and 17C show the distortion and focus plot diagrams respectively. The 
projection system 700 has keystone distortion and does not fill the top of the 
display surface. The cabinet thickness T3 is about 13 inches thick with the 
same 67" diagonal display for a resulting DtoD ratio of 5.15. In the projection 
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system 700, the curved mirror 702 corrects the keystone distortion and adds 
enough magnification to make the image fill the display surface 20. The 
resulting distortion is approximately 3%. This can be improved with further 
optimization as well as with the use of the image processing unit 12. 
5 Furthermore, a corrector lens is not being used and a slight de-focusing has 
been removed by tilting the projection lens of the projection light engine 14 
approximately 0.8 degrees. Electronic correction was not used for FIGS. 17B- 
C. 

[00112] In the projection systems of FIGS. 16A and 17A, the curved 
10 mirrors 602 and 702 still require a vertically oriented concave surface to 
correct for vertical expansion due to keystone distortion. However, in this case 
the curved mirrors 602 and 702 require only a horizontally oriented convex 
surface to correct for horizontal compression, of which there is more at the 
bottom than at the top of the display surface. In this case, the projection lens 
15 has been designed to produce a horizontal image size at the top of the 
display surface that is equal to or a little smaller than desired, so the 
horizontal mirror curvature at the top of the curved mirrors 602 and 702 only 
needs to be slightly convex. Correspondingly, at the bottom of the display 
surface, keystone distortion will result in a horizontal image size that is much 
20 smaller than desired, so the horizontal mirror curvature will need to be more 
convex, to provide more magnification. Nonetheless, the curved mirrors 602 
and 702 still perform the same function and have the same basic shape as 
the aspherical mirror 39 and are therefore rotationally non-symmetric. 

[00113] The corrector lens 49, whether a discrete lens, or part of a 
25 compound lens, performs the same functions whether it is being used with a 
small or large aspherical rotationally non-symmetric mirror. Accordingly, the 
corrector lens 49 has the same basic shape in either case. In general, the 
shape of the corrector lens 49 tracks the shape of the curved aspherical 
mirror because the corrector lens 49 is trying to appropriately shape (i.e. 
30 reduce beam-spreading and hence reduce spot size) the light beams going 
into the aspherical mirror. In general, there is a pronounced asymmetry 
between the top and bottom of the aspherical mirror, and hence the corrector 
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lens, due to the off-axis geometry. This is why the aspherical mirror and the 
corrector lens are rotationally non-symmetric. 

[00114] The systems of FIGS 15 to 17 were designed using a projection 
light engine with an 8-element projection lens having a 12.3 mm focal length 

5 lens at f:5 and an 18 mm diagonal micro-display. The micro-display has a 
pixel pitch of 12.27 microns for a size of 1280 x 720 pixels, or 8.17 microns for 
a size of 1920 x 1080 pixels. This projection light engine has a projection exit 
cone angle of 32.8 degrees. The other systems shown herein were designed 
using a projection light engine with an 8-element projection lens having an 

10 18.7 mm focal length lens at f:2.8 and a 0.9 inch micro-display. This projection 
light engine has a projection exit cone angle of 31.7 degrees. However, other 
types of projection light engines could be used with the present invention. 
Furthermore, the side views of the projections systems shown herein are 
drawn to scale. The projection systems are shown for exemplary purposes 

15 and are not meant to limit the invention. 

[00115] Rear Projection systems also always include a means for 
directing the light from the projected image into a beam that emerges 
horizontally from the display surface (i.e. screen) towards the audience in 
front of it. A screen assembly with an included Fresnel lens is typically used 

20 because Fresnel lenses are a light, relatively inexpensive means of 
collimating a large bundle of light being projected from a point source (i.e. 
from within the projector 25). Further, the spatial distribution of light tends to 
favor the central portion of a Fresnel lens. In order for a Fresnel lens to be 
beneficially used within the projection system 10, the focal length of the 

25 Fresnel lens should match the distance from the point source (in particular, 
the surface of the light-modulating micro-display device). The Fresnel lens is 
used to rotate and collimate the light rays carrying the near-perfect optical 
image that has arrived at an angle to the rear of the display surface 20. The 
light rays forming the optical image impinge upon the Fresnel lens at different 

30 angles depending upon their position on the display surface, and the Fresnel 
lens must rotate the light rays through an appropriate angle (vertically, as well 
as horizontally) in order to deliver the light rays at an exit angle perpendicular 
to the screen. As mentioned previously, the center of the Fresnel lens will be 
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considerably offset downwards from the center of the display surface, the 
degree of offset being dependent on the DtoD ratio of the projection system 
(i.e. the amount of off-axis geometry being used). 

[00116] In an alternative configuration, the aspherically curved mirror in 

5 the various embodiments can be a reflective Fresnel mirror. A Fresnel mirror 
replaces the curved surface of a conventional mirror with a series of 
concentric grooves, molded into the surface of a thin, lightweight plastic 
sheet. The grooves act as individual reflecting surfaces, like tiny prisms when 
viewed in cross section, reflecting parallel rays in a very close approximation 

10 to the original thick curved mirror surface. The Fresnel mirror can be made by 
cutting equal pitch circular grooves on a mold to replicate the curvature of the 
aspherical curved mirror, fabricating a Fresnel structure from this mold and 
then metallizing the structure's surface to give it a Front Surface Mirror (FSM) 
finish. This Fresnel-aspherical mirror can reduce the cabinet depth of the 

15 projection system by another inch or two, by eliminating the sag of the curved 
mirror. In one example, by substituting a Fresnel mirror for a curved mirror in 
a 60" diag by 8" thick system, a thickness savings of 1.5" may be realized, 
and a DtoD ratio of perhaps 9:1 (i.e. a 60" diagonal with a 6.5" depth) can be 
achievable. This is not a trivial substitution as the Fresnel mirror must be 

20 made from a symmetrical mirror design, and the slight reduction in thickness 
implies a slight change in throw ratio. However, the reduction in cabinet 
thickness is the motivation for developing Fresnel mirror solutions. The 
Fresnel aspherical-mirror is the same size as the curved mirror that it 
replaces, however it is much thinner. The Fresnel mirror also reduces 

25 keystone distortion just as the aspherical, non-symmetrical curved mirror does 
since the tiny, reflecting grooves on the Fresnel mirror provide a similar effect 
as the surface curvature of the aspherical, non-symmetrical curved mirror. 
However, the performance of the Fresnel mirror in reducing keystone 
distortion may not be as good as that of the aspherical, non-symmetrical 

30 curved mirror for the symmetrical Fresnel mirror (in this case, the image 
processing unit needs to provide more distortion correction). 

[00117] As an example, the Fresnel mirror can have a 0.1mm groove 
pitch, with natural diamond tools cutting the grooves by taking up to 5 
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successive cuts at each radius. The tools are specially cut with specific tip 
included angles, and the molds are made of brass, with a specialized liquid 
that is used to flood the cutting area both for cooling purposes and to remove 
the machined material as is known to those skilled in the art. The Fresnel 
5 aspherical-mirror is preferably non-symmetric in order to duplicate the 
performance of the curved rotationally non-symmetric mirror for which it is 
substituted. However, current manufacturing limitations impose rotational 
symmetry to Fresnel mold structures as these are machined on lathes. The 
use of a symmetrical Fresnel mirror implies that the projection lens design 
10 and the image processing unit 12 must bear more of the responsibility for 
distortion correction and focus spot reduction. 

[00118] Referring now to Fig. 18A, shown therein is another 
implementation of a projection system 750 in accordance with the present 
invention in which a Fresnel mirror 752 is used in place of the aspherical 

15 curved mirror. The projection system 750 further comprises a mirror 754, 
which can be flat or curved, a projection light engine 756, a display surface 20 
and an image processing unit (not shown). The mold for the Fresnel mirror 
752 can be made by current technology since it is designed to be machined 
on a lathe, that is, the Fresnel mirror is designed to replace a rotationally 

20 symmetric aspherical mirror. Conventional ultraviolet cured polymer 
technology can be used to produce a plastic film from the mold, and this 
plastic film contains the grooves that represent the optical properties of the 
aspherical mirror. This film will need to be mounted on a rigid substrate (it 
could be bonded to glass, for example, which is a well-known technique). To 

25 obtain the mirror surface, a method of depositing a reflective surface on the 
grooved side of the film is needed which is commonly known to those skilled 
in the art. Once the complete Fresnel mirror is fabricated, a quadrilateral 
segment is cut from the center of the complete Fresnel mirror to provide the 
Fresnel mirror 752. This quadrilateral segment is used as the mirror 752. FIG. 

30 18 B shows a 3D representation of the shape of the original curved mirror 
segment underlying the equivalent quadrilateral Fresnel mirror segment 752 
that is cut out of the complete Fresnel mirror. 
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[00119] Referring now to FIG. 18C, shown therein is a distortion plot that 
shows the performance of the projection system 750 when a corrector lens is 
not used and the projection light engine 756 is not designed with the corrector 
lens functionality. It should be noted that because the Fresnel mirror 752 does 

5 not have the asymmetrical properties of the aspherical, rotationally non- 
symmetric curved mirror of the present invention, the Fresnel mirror 752 can 
not correct for keystone distortion as effectively. However, the addition of a 
corrector lens (whose profile is shown in FIG. 18D) makes a significant 
difference in the distortion plot as shown in FIG. 18E. In this case, the 

10 corrector lens is not restricted to being symmetrical (as it can be molded 
rather than machined on a lathe) and has to play a bigger role in reducing 
spot defocus. The distortion plot shown in FIG. 18E can be improved to 
acceptable levels of <1% using digital image processing. In this particular 
example, the sag of a corresponding aspherical, symmetrical mirror segment 

15 is 45mm, and by substituting a 3mm thick Fresnel mirror 752, the cabinet 
depth is reduced by 42mm. 

[00120] FIG. 18F shows the top view of a custom projection lens that 
can be used with the Fresnel mirror 752. The projection lens 760 is identical 
to the projection lens shown in FIGS. 21A-B, except that the second lens 

20 element 762 has been changed so that the aspherical, asymmetrical surface 
of the lens element 762 has the lens profile shown in FIG. 18D. Similarly, FIG. 
18G shows the side elevation of the projection lens 760. Similar to the 
projection lens of FIG. 21, the projection lens 760 also uses shift and tilt 
techniques in its design. The lens element 762 incorporates the functionality 

25 of a corrector lens which must deal with an aspherical, rotationally 
symmetrical Fresnel mirror. The corrector lens surface is aspherical and 
asymmetrical, and is the surface on the right side of the lens element 762. 
The primary purpose of the corrector lens surface is to correct for defocusing 
although the lens surface will also partially correct for keystone distortion. 

30 [00121] As mentioned previously, tilt and shift of the projection lens in 
the projection light engine can be used to correct for distortion introduced by 
the aspherical mirror. In particular, lens shift or shift of the micro-display 
device with respect to the projection lens, can be added to any of the off-axis 
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projection systems of the present invention to reduce keystone distortion. It 
should be understood that lens shift is just another technique in correcting for 
the keystone distortion that results from off-axis projection, and hence another 
one of the ways that improved DtoD ratios can be obtained. 

5 [00122] With respect to FIG. 18, exemplary dimensions for the various 
components will now be given. For the mirror 754, the tilt angle is -19 
degrees, the distance from the last lens surface in the projection lens is 
65.087736 mm (center ray) and the X.Y corner coordinates in mm are: 
(68.766592 92.704316), (51.292765, 10.947695), (-51.297133, 10.949841) 

10 and ( -68.765149, 92.709893). For the Fresnel mirror 752, the mirror sag is 
46.34 mm, the tilt angle is +19 degrees, the distance from the mirror 754 is 
353.0113 mm (center ray) and the X,Y corner coordinates in mm are: 
(333.965543, 464.941499), (252.931401, 74.623281), (-252.963970, 
74.640022), and (-333.957131, 464.974787). For the display surface 20, the 

15 tilt angle is -19 degrees, the distance from the mirror 752 is 539.7357 mm 
(center ray) and the size is 1326mm wide by 747 mm high with a 1524 mm 
diagonal. 

[00123] Referring now to FIG. 19A, shown therein is a prior art 30 
degree off-axis projection system 780 that will produce 27% keystone 

20 distortion, as shown in FIG. 19B. The projection system 780 does not use 
lens shift. Referring now to FIG. 19C, shown therein is a prior art projection 
lens arrangement for a projection light engine 800 that employs offset or shift 
which means that there is an offset/shift between the centerlines of the optical 
axis running through the micro-display/TIR prism assembly 802 and the 

25 optical axis of the projection lens 804 itself. In this particular example, if the 
projection light engine 800 is used in an on-axis projection system, the shift is 
of a sufficient magnitude to produce the 27% keystone distortion of FIG. 19B. 
However, referring now to FIG. 19D, shown therein is a 30 degree off-axis 
prior art projection system 820 that utilizes the projection light engine 800. In 

30 this arrangement, the shift of the projection light engine 800 is of a sufficient 
magnitude to remove the keystone distortion (see FIG. 19E). None of FIGS. 
19A-E show the components of the present invention, however the prior art 
techniques shown in FIGS. 19C-D can be added to any of the embodiments 
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of the present invention to help provide reduced cabinet depth with 
satisfactory image quality. 

[00124] The projection lens shift causes most of the lower half of the 
projection lens 804 to be used, and part of the upper half of the projection 
5 lens 804 to not be used since light rays do not go through that portion of the 
projection lens 804. However, since the outer periphery of a spherical 
projection lens causes more aberrations than the central portion, the 
projection lens must be designed to have a larger diameter than a projection 
lens in which no shift/offset is used which slightly increases the cost of the 

10 projection lens in exchange for being able to use more paraxial rays. If the off- 
axis angle of the projection system were larger so that there is more than 27% 
distortion, then there would be some excess distortion of a few percent that is 
not corrected by the shift. This excess distortion can be dealt with by either 
the image processing unit 12, a curved mirror or a combination of both. 

15 Alternatively, if the off-axis geometry of the projection system had a lower 
angle so that there is less than 27% distortion, the projection lens 800 will 
overcorrect and there will be some distortion of the opposite sign (i.e. the 
bottom of the image is larger than the top of the image on the display surface) 
and that can be corrected by either the image processing unit or a change in 

20 mirror profile. 

[00125] The value of 27% is given as an example and other amounts of 
shifts in the projection lens 800 can be used to correct for other amounts of 
distortion. However, the shift that can be applied can result in an expensive 
design because as more shift is applied, the coverage at the entrance pupil of 

25 the projection lens has to be large enough to cover a circle encompassing the 
shifted micro-display and the lens has to be of a wide enough angle design to 
throw this image onto the display surface. It should be noted that a small 
amount of shift is commonly used in table-mounted front projectors so that the 
projected image is projected slightly off-axis upwards without distortion and 

30 without interference from the surface of the tabletop. 

[00126] Lens shift complicates projection engine design, but when it is 
used, it can be effective. Closely related to lens shift is lens tilt. It is known by 
those skilled in the art that advanced projection light engines can benefit by 
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using both of these techniques. However, either can be applied alone. Lens 
tilt is typically used to correct focus problems due to a tilted focal plane. In the 
examples shown so far, there are no tilted focal planes (i.e. the micro-display 
and the display surface are parallel). However, when lens shift is used, there 

5 is an offset of the image due to the lens shift (i.e. if 50% offset is used, the 
bottom of the image will be near the center of the projection lens). Since the 
image produced by any lens has a curved field, the top of the image projected 
onto the display surface focuses closer than the bottom of the image 
projected onto the display surface. A configuration in which the planes of the 

10 micro-display, the lens, and the display surface all intersect along the same 
line will reduce keystone distortion. This is known as the Scheimpflug 
principle which is shown schematically in FIG. 20B for a front projection 
system 900. To combat spot defocusing, the projection lens can be tilted to 
reduce the effect of 'field curvature'. Alternatively, the display surface could be 

15 tilted inwards, but it's easier to tilt the projection engine a little outwards. 

[00127] Referring now to FIG. 20A, shown therein is a prior art 
projection light engine 900 in which there is a tilt in the axis of the projection 
lens 902. This tilt can be added to any of the projection systems of the 
present invention to reduce the effect of field curvature spot defocusing and 

20 improve system performance while reducing cabinet depth. The tilt is between 
the plane of the image surface of the micro-display 904 and the plane of the 
aperture inlet plane of the projection lens 902. In this example, the tilt 
amounts to a couple of degrees and typically is of the order of 1 to 2 degrees 
depending on whether there is a shift in the projection light engine and the 

25 magnitude of the shift. The spherical wavefronts that emerge from any 
physical lens results in the best focused image points lying along a spherical 
surface at a radius of the focal length. The Scheimpflug principle states that if 
the planes of the imager, the lens plane and the display surface all intersect 
along the same line, focus spots will be minimized. 

30 [00128] Referring now to FIG. 20B, the projection light engine 900 with 
built-in micro-display tilt is shown in a configuration satisfying the Scheimpflug 
condition. The "plane of best focus" shown in the figure is actually a plane of 
optimal focus, as the best focused points always lie along a spherical surface. 
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This plane is shown intersecting the field of curvature of the projected image. 
The display surface must be moved to coincide with this plane by 
mechanically reducing the angle between the plane of the display surface and 
and a plane perpendicular to the principal axis of the projection lens. The 
5 other components of the projection system such as the aspherical mirror, etc. 
are not shown for clarity, but obviously, they are present. The best focus is 
always along an arc, so there will always be focus problems on a flat screen. 
In an off-axis projection system of the present invention, the projection light 
engine 900 with built-in tilt can be used to reduce the focus problems. If the 

10 display screen was tilted a few degrees to coincide with the plane of optimal 
focus (which is superimposed for best fit in the spherical wavefront of best 
focus) then spot sizes would be improved. Conceptually, it is easier to tilt the 
projection lens 902 backward relative to the micro-display 904 and then tilt the 
projection light engine forward a few degrees so that the Scheimpflug 

15 principle is met. Mechanically, this has to be implemented by careful design of 
the lens mount and the use of precisely inclined lens barrels and/or off-axis 
machining and/or special shims/washers, etc The tilted projection lens 900 
can be used in any of the projection systems of the present invention. The 
concept is also applicable to both front and rear projection systems. 

20 [00129] It is possible to use an off-the-shelf projection lens, and tilt or 
shift (i.e. offset) the lens to be used with a light engine with a smaller micro- 
display than the projection lens was designed for. Of course, some 
mechanical changes, as mentioned above, will need to be implemented. It 
should be understood that a projection light engine can be used with any of 

25 the embodiments of the present invention, in which the projection light engine 
employs no lens shift or tilt, only lens shift, only lens tilt or a combination of 
both lens shift and tilt For instance, an off-the-shelf projection lens designed 
for a specific light modulator can be modified for use with a different, smaller 
light modulator by applying a shift and tilt. For example, the inventors shifted a 

30 commercial lens designed for a 1.2" diagonal light modulator by 50% and 
tilted the lens a fraction of a degree for use with a 0.8" diagonal light 
modulator. A shift of 50% means that the top edge of the micro-display is 
shifted down to the center of the projection lens causing most of the projected 
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image to be thrown from the top-half of the lens. In this case, the image 
quality was good enough that a corrector lens was not necessary, and so the 
expense of a custom projection lens design was saved. However, this design 
would have necessitated modifications to the projection light engine, first for 

5 the 0.8" micro-display to accommodate the shift and tilt necessary for the off- 
axis configuration and second, for the attachment of a projection lens 
designed for a different light engine. The result is a rear projection off-axis 
system with a 60 inch diagonal and an 8 inch cabinet depth using a 0.8" light 
modulating micro-display. This was achieved by using a projection lens 

10 designed for a conventional projection system having a 60 inch diagonal and 
20 inch cabinet depth using a larger (possibly more expensive) 1.2" light 
modulating micro-display. 

[00130] As mentioned previously, a custom-designed projection lens 
mounted on a light engine can be used in the various embodiments of the 

15 invention to eliminate the corrector lens 49. The custom projection light 
engine can include the corrector lens 49 in its projection lens housing. In this 
case, the housing of the projection light engine is longer and the overall 
projection light engine is more expensive. Alternatively, the custom projection 
light engine can include a custom lens element that has an aspherical 

20 rotationally non-symmetric curvature for partially or fully correcting the 
distortion introduced by the curved, aspherical mirror. In this case, the custom 
projection light engine is more compact. 

[00131] An example of a custom lens that can be used with an 
aspherically curved, rotationally asymmetric mirror is shown in FIGS. 21A-C. 

25 It is to be noted that this design was also used to work with an aspherically 
curved, rotationally symmetric mirror (in order to substitute this mirror with a 
Fresnel mirror) as well (see FIG. 18F-G), but a surface profile of one of the 
lens elements had to be changed. Referring now to FIGS. 21 A and 21 B, 
shown therein are top and side cross-sectional views, respectively, of an 

30 eight-element custom projection lens 950. The elements of the projection lens 
950, starting from the right are: a first element 952 with a convex and concave 
surface; a second element 954 with an asymmetrical, aspherical concave 
surface, a third element 956 which is a doublet, a fourth element 958 which is 
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a biconvex lens, a fifth element 960 which is a doublet, a sixth element 962 
which is a doublet, a seventh element 964 which is a biconvex lens, and an 
eighth element 966 which is a plano-convex lens element. Both lens shift and 
tilt are used and FIG. 21 B shows the shift (offset) quite clearly, though the tilt 
5 is a little harder to see. The tilt begins at lens element 966. 

[00132] FIG. 21 C shows the profile of an aspherical, rotationally, non- 
symmetrical surface that has been incorporated into the second lens element 
954 of the custom projection lens 950. In the side view of FIG. 21 B, there 
appears to be some interference between this surface and the second surface 

10 of lens element 952 but in practice this would not occur as the bottom portion 
of the lenses are not used (due to the shift) and could be ground off. The 
projection lens 950 has correction for focus and can be used on any of the 
curved mirror systems that use a corrector lens. The projection lens of FIG. 
18 does correction for keystone distortion that cannot be completely handled 

15 by the Fresnel mirror due to constraints of having to use a symmetrical 
surface. 

[00133] Referring now to FIG. 22, shown therein is a block diagram of 
an example embodiment of the image processing unit 1000 of the present 
invention. The image processing unit 1000 can be integrated with the optics of 

20 any embodiment of the present invention to correct for any remaining 
keystone and other spatial distortion. The image processing unit 1000 
comprises an image capture module 1002, an image processor module 1004, 
a display controller module 1006, a controller 1008 and a memory interface 
module 1010 connected as shown. The image capture module 1002, image 

25 processing module 1004 and display controller module 1006 are all 
connected to the memory interface module 1010 for storage and retrieval of 
data and parameters. 

[00134] Raw image data is retrieved by the image capture module 1002 
and digitized therein. The digitized image data is then sent to the image 
30 processor module 1004 for digital image processing and keystone correction 
via the luminance correction stage 1012 and the image warping stage 1014. 
The image processor module 1004 obtains distortion parameters from the 
controller module 1008 and produces an image transformation, via the image 
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warping stage 1014, to distortion-compensate the digitized image data. This 
distortion-compensated digital image data is then passed on to the display 
controller module 1006, which modulates light based on the distortion- 
compensated image data and projects this light out of the light engine. When 
5 this light propagates through the bulk optics and onto the display surface of a 
projection system, the distortion due to the bulk optics nullifies the 
compensatory distortion present in the image and the resulting display is 
substantially distortion free. 

[00135] The luminance correction stage 1012 is used to correct for 
10 brightness or luminance non-uniformity. Accordingly, the luminance correction 
stage 1012 receives the input image data and produces luminance adjusted 
image data. The luminance correction stage 1012 applies a pre-determined 
map to correct the pixel brightness in color space at specific pixel locations 
since the intensity of a point or section of the displayed image varies inversely 
15 with the square of the distance traveled, this leads to brightness variations 
within the displayed image. Various equations for image maps can be used (a 
linear example was given previously). 

[00136] The image warping stage 1014 is used to correct for the 
combination of remaining uncorrected distortion due to the projection lens 5, 

20 the corrector lens 49, the aspherical mirror 39, the off-axis projection 
geometry, and installation misalignments. The image warping stage 1014 
applies a transformation to the input image (an example of which is shown in 
FIG 9a) to distortion-compensate the input image according to geometric 
transformations that are the inverse of the geometric distortions (not shown) 

25 introduced by the projection light engine 14 and the associated reflection 
(mirror) optics (not shown). Accordingly, the image warping stage 1014 
receives the luminance adjusted image data and produces the distortion- 
compensated image data. The image warping stage 1014 allows for a more 
flexible choice of optical lenses, since any associated distortions will be 

30 eliminated by pre-warping, rather than by matching the optical properties of 
the lenses of the projection light engine. A particular implementation of the 
image warping stage 1014 is given by Greggain et al. U.S. 5,594,676 which is 
herein incorporated by reference. 
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[00137] The luminance correction stage 1012 and the image warping 
stage 1014 can act equally on all component wavelengths of white light 
However, this stage can also act differently according to the R, G, and B 
wavelengths. This results in a further benefit, namely the correction of lateral 
5 color shifts and the correction of certain chromatic aberrations. If chromatic 
aberrations and lateral color shifts can be corrected by the image processing 
unit 1000, the projection lens design may be greatly simplified, with a 
corresponding savings in manufacturing costs. However, electronics costs will 
go up because of the need for three identical image-processing engines 
10 instead of one in each of the stages of the image processing unit. 

[00138] The luminance-correction stage 1012 and the image warping 
stage 1014 may be implemented by a software module or by dedicated 
processing circuitry such as a digital signal processor or an application 
specific integrated circuit. The order of these stages in the data path may also 
15 be interchanged. 

[00139] In use, a comprehensive range of values for distortion 
parameters that cover the entire space of distortion parameters is first 
obtained for the image processing unit 1000. The values for the distortion 
parameters can be obtained via a user interface and can be determined off- 

20 line according to various geometrical and optical configurations of the 
projection system. For each single set of values for the distortion parameters, 
a transformation is obtained which parameterizes the distortion compensation 
transformation that is applied by the image warping stage 1014. A distortion 
map database is then prepared covering the entire space of possible values 

25 for the distortion parameters. Access to this database is necessary every time 
calibration is required for the projection system which can occur at 
manufacturing, after shipping, etc. A single distortion transformation is then 
extracted from the distortion map database that corresponds to the final 
distortion parameters of the projection system (i.e. once the projection system 

30 is installed, the distortion parameters won't change too much because the 
optical alignment is intact). The final distortion map is used by the image 
warping stage 1014 to geometrically adjust (i.e. distortion compensate) the 
digitized input image data. 
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[00140] In general, the various performance figures shown herein for the 
embodiments of the projection system in accordance with the present 
invention do not show the correction that is performed by the image 
processing unit 12. However, it should be understood that when electronic 
5 correction is provided by the image processing unit 12, the distortion is 
reduced significantly, to values equal to or less than 1%. 

[00141] The inventors have found that DtoD ratios may be improved, 
while retaining acceptable image quality, in a projection system that uses 
various combinations of lens tilt, lens shift, possibly one or more aspherical 

10 elements in the projection lens optics, at least one curved aspherical mirror 
and electronic distortion correction. The electronic distortion correction 
provided by the image processing unit can be used as an extra degree of 
freedom to "tune out" residual distortion which either results from the design, 
or is due to individual component deviations and/or mechanical assembly 

1 5 tolerances for various combinations of the above elements. 

[00142] Current state of the art for DtoD ratios in consumer RPTVs is 
about 3.2:1. Current state of the art for DtoD ratios in professional rear 
projection systems (which are 3 to 5 times more expensive than consumer 
products) is about 6:1. The various embodiments of this invention will allow 

20 consumer RPTVs to achieve DtoD ratios of over 5:1. For example, it is 
possible to achieve a DtoD ratio of 5.5:1 using a large curved mirror design 
with a simple aspherical projection lens and the image processing unit. 
Another example is a DtoD ratio of 7.5:1 by adding micro-display shift and tilt 
to the previous case and re-optimizing the lens profile for a custom design. 

25 Other examples for consumer RPTV products include: a) a DtoD ratio of 6 for 
a small curved mirror, off-axis projection system (similar to that shown in FIG. 
6), using no tilt or shift in the projection lens, with an external corrector lens; 
b) a DtoD ratio of 7 for a large curved mirror, off-axis projection system 
(similar to that shown in FIG. 16A), using no tilt or shift in the projection lens, 

30 with an external corrector lens; c) a DtoD ratio of 7.5 for a large curved mirror, 
off-axis projection system using tilt as well as shift in a custom projection lens 
design; (this could be achieved by using the lens shown in FIG 18F-G in the 
configuration shown in FIG. 18A) and, d) a DtoD ratio of 8.5 for a large 
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Fresnel mirror, off-axis projection system using tilt as well as shift in a custom 
projection lens design (this could be achieved by using the lens shown in FIG. 
21A-B in the configuration shown in FIG. 16A). It should be understood that 
the details about screen diagonal and cabinet thickness are not very 
5 important, only the ratios, as everything scales linearly as long as certain 
minimum mechanical dimensions are met in order for the projection light 
engine to fit within the thickness of the cabinet. 

[00143] However, there are cost and performance tradeoff implications 
in the use of these techniques. For example, the use of lens or micro-display 

10 offset includes using a larger lens aperture which increases cost. The tradeoff 
is that a larger lens/micro-display offset allows for more keystone distortion 
correction but the cost of the projection lens increases since larger lens 
elements are needed. Further, when aspherical, rotationally non-symmetric 
lens elements are used, costs are increased since tooling costs increase for 

15 creating injection molded lens elements. In addition, when creating 
aspherical, rotationally non-symmetric mirrors there are cost increases for 
fabricating front surface mirrors with accurately profiled optical surfaces (mold 
machining costs may also have to be incurred). 

[00144] As has been shown with the various embodiments discussed 
20 herein, the present invention is applicable to 1, 2 and 3 mirror off-axis 
projection systems in which either at least one of the mirrors has a curved 
surface or, one of the mirrors is positioned at an off-axis angle to the light 
beam, or both. In all cases, a corrector lens or a custom designed projections 
lens is used to correct for the distortion after the image has been reflected by 
25 the curved mirror. In addition, an image processing unit is required to correct 
for any residual distortion. Further, the addition of one or more flat mirrors to 
the configuration allows further tradeoffs in vertical height vs cabinet depth to 
be made. The use of a greater number of mirrors also provides for extra 
flexibility in positioning the components of the projection system and the 
30 ability to decrease the cabinet thickness but the penalty is more difficulty in 
alignment. Using two curved mirrors also allow for the possibility of making 
some simplifications in mirror fabrication, but once again there is extra 
complexity in alignment. The use of Fresnel mirrors has the potential to 



-48- 



replace large curved mirrors, yielding cost reductions as well as further 
improvements in cabinet thickness and DtoD ratios. 

[00145] In accordance with the present invention, a typical design 
process for designing a projection system with at least one curved mirror and 
5 an image processing unit includes the following steps: 

I) Define the design constraints for the projection system: 

1) define the parameters of the projection light engine 
such as the projection lens design which includes the focal length, the f# (i.e. 
the ratio of lens diameter to focal length), etc.; 

10 2) define the cabinet depth, the number of mirrors (1, 2 or 

3) and which mirrors are curved, the cabinet configuration (free-standing, wall 
unit, etc.), the size of the display surface, etc.; 

II) Define an initial configuration for the mirrors: 

3) Use at least one mirror to set up the angle and 
15 distance between the projector light engine and the mirror (if one mirror is 

used it is curved; if more than one mirror is used then one of the mirrors may 
be flat); if a Fresnel mirror is to be used in place of a large, curved mirror; 

a) optimize the angles and distances between the 
projection light engine and the mirror(s) to minimize keystone distortion while 

20 keeping the projection path of the optical image clear (i.e. to avoid casting 
shadows in the optical image; note that the projection path will change with a 
curved mirror surface); 

b) adjust the shift and tilt of the projection lens 
relative to the display device (or vice-versa) to minimize distortion and spot 

25 smearing/defocusing if allowed by the projection light engine (this step may 
also include re-optimizing the angles and distances mentioned in step 3a); 

4) Select a certain initial configuration, material and 
starting dimensions for the curved mirror in a suitable optical simulator (such 
as Oslo™, Zemax™, etc; 

30 III) Optimize the surface contour of the curved mirror and design 

the corrector lens; 
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5) Set up an optimization error function (provided by the 
simulator such as mean square error, etc.) to minimize the distortion caused 
by the curved mirror and optimize the surface contour of the curved mirror to 
minimize the error function; 

5 a) adjust the constraints as needed for the 

thickness, curvature and tilt of the curved mirror; 

b) re-simulate and re-adjust the constraints as 

needed; 

c) check the optical path for conflicts; 

10 d) repeat steps 5a through 5c until acceptable 

distortion and focus spot sizes are obtained for the projection system; 

6) Apply steps 4 and 5 for the design of the corrector lens 
(or lens surface within a custom projection light engine design) while 
optimizing the corrector lens for providing minimal focus spot size and 

15 preventing excessive distortion while constraining the corrector lens within 
mechanical requirements (i.e. the corrector lens is designed to be larger than 
its nominal size because of artifacts that are caused by the oscillations of the 
mathematical functions that define the surface profile of the corrector lens as 
they converge to the desired surface profile; the part of the corrector lens 

20 outside of the nominal dimensions is simply not fabricated); 

7) Re-optimize the curved mirror to minimize any 
distortion introduced by the corrector lens or custom projection lens (this may 
involve slightly adjusting the profile of the curved mirror by adding positive 
and/or negative curvatures, adjusting the transition rate between the concave 

25 and convex curvatures, etc.); and, 

8) Re-optimize the corrector lens to minimize any 
degradation in focus spot size that is introduced by changes in the curvature 
of the curved mirror. 

[00146] This process yields diminishing returns very quickly and the 
30 solution will converge quickly to optimal values if suitable initial profiles are 
selected for the corrector lens and the curved mirror. These profiles may be 
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approximated by 3 rd order or 5 th order polynomials. Interpolation using a bi- 
cubic spline function, a cosine function or a similar mathematical function can 
be used in designing the surface curvature of the mirrors. Excel spreadsheets 
or any other suitable computer program may be used to calculate these 
5 approximations. 

[00147] The projection system 10 provides for near distortion-free 
projection of an optical image through the use of particularly configured 
projection elements. The projection system 10 incorporates a general short 
throw optical system that has inherent distortion while achieving the short 

10 throw distance with an image processing unit that corrects for geometric and 
other optical distortions. The projection system 10 uses an aspherical mirror 
39, a corrector lens 49, and electronic correction to achieve a desired short 
throw ratio with acceptable distortion levels. The image processing unit 12 
performs corrections for the combined spatial distortion of the projection light 

15 engine, the optical reflection assembly, the projection geometry, as well as all 
three axes of rotation of the assembly alignment. The image processing unit 
12 can address keystone distortion and barrel/pin-cushion distortion as well 
as color non-convergence (which may be due to misalignment of the micro- 
display in the x, y or theta axis). In particular, the image processing unit 12 

20 provides arbitrary scaling (in both the horizontal and vertical dimensions as 
well as different regions of an image) as well as linear up and down scaling 
for all visible wavelengths of light, equally, or, with specifically programmed 
arbitrary scaling for each of several desired passbands of light. Chrominance 
and luminance non-uniformity may also be corrected by the image processing 

25 unit 12. Lens designs may be simplified because lens aberrations and 
distortions such as the common spherical aberrations and lateral color shifts 
are amenable to electronic correction. Since the image processing unit 12 
serves to eliminate any residual distortions, the system design is no longer 
limited by the constraint of minimizing distortions optically. This also has the 

30 added benefit of being able to apply any fine-tuning digitally rather than more 
complicated optical means. Variations can be obtained by combining several 
mirrors (planar and/or non-planar) and/or projection light engines. This system 
design methodology is applicable to both front and rear projection setups. 
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[00148] In another alternative, it is possible to use a light modulating 
micro-display device that is shaped to accommodate for keystone distortion 
and other spatial distortion. The micro-display device consists of appropriately 
shaped pixels such that when the modulated light traverses an off-axis optical 
5 path, which may consist of a projection lens, and one or more mirrors, part or 
all of the resulting distortion is corrected, resulting in a correct image being 
projected on the display surface. If the micro-display device is made for a 
conservative off-axis system, it can be used with a flat mirror in a conservative 
DtoD system, and with a curved mirror for a more aggressively specified 

10 system. The advantage is that the optics and the image processing can be 
simplified. However, this needs to be weighed against the cost of fabrication 
of a custom micro-display device. One of the difficulties in making such a 
micro-display device is etching photolithographic masks with lines that did not 
run at right angles to each other, since at very small geometries, "staircasing" 

15 or "jaggies" could be apparent in the line structure. Fortunately, the 
geometries used for fabricating these micro-displays seldom have to be as 
small as those required for memory and processing devices. 

[00149] It should be noted that the various embodiments shown herein 
area also applicable to a compact front projection system. However, for a 
20 front projection system, there is no need for a Fresnel lens in the display 
screen. 

[00150] As will be apparent to those skilled in the art, various 
modifications and adaptations of the structure described above are possible 
without departing from the present invention, the scope of which is defined in 
25 the appended claims. 



